IN THE CLAIMS 



Please amend the claims as follows. Presented below is a complete listing of 
claims in the revised format showing markings as set forth by the U.S. Patent and 
Trademark Office on January 31 , 2003: 

1 . (Currently Amended) A process for measuring effectiveness of a web 
site having a test web page, the process comprising: 

d e s i gn i ng ono or mor e having a plurality versions of the test web page; 

distributing web page access requests to the various versions of the test web 
page according to a predetermined distribution function; and 

counting visits to one or more hyperlinks from each version of the test web 
page to determine a relative effectiveness of each version of the test web page. 

2. (Original) The process as recited in claim 1 , wherein said 
predetermined distribution function is a sequential function. 

3. (Original) The process as recited in claim 1, wherein said 
predetermined distribution function is a random function. 

4. (Previously Presented) The process as recited in claim 1 , wherein 
distributing requests comprises: 

receiving requests for the test web page; 

directing said requests to one of the versions of the test web page in 
accordance with the predetermined distribution function. 
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5. (Currently Amended) The process as recited in claim 1 , further 
comprising: 

repeating the process; 

after a period prosot numb e r of r e petitions , evaluating a success of each 
version of the test web page; and 

selecting a version having a highest success rate, and setting the test web 
page to the selected version. 

6. (Currently Amended) A process for directing requests for a test web 
page having a predetermined universal resource location (URL) comprising: 

d e sign i ng on e or mor e having a plurality of versions of the test web pages; 

distributing requests to a version of the test web page according to a 
predetermined distribution function wherein said requests are distributed by directing 
requests for the test web page to one of the versions of the test web page in 
accordance with a predetermined distribution function; and 

measuring a relative effectiveness of each version of the test web site, based 
on a success percentage. 

7. (Original) The process as recited in claim 6, wherein said 
predetermined distribution function is a random function. 

8. (Original) The process as recited in claim 6, wherein said 
predetermined distribution function is a sequential function. 
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9. (Previously Presented) A method of measuring the effectiveness of a 
web page having different versions, the method comprising: 

displaying a version of the web page to a user, the version selected according 
to a predetermined distribution function; 

for each version of the web page, counting occurrences of a desired behavior 
of the user to track the effectiveness of that version of the web page. 

10. (Previously Presented) The method of claim 9, further comprising, 
upon completion of testing: 

identifying an effective version of the web page based on the percentage of 
success of achieving the desired behavior; and 

setting the web page to a most effective version of the web page. 

1 1 . (Previously Presented) The method of claim 10, wherein the most 
effective version of the web page is not identical to any of the versions tested, and 
the most effective version of the web page includes features from more than one 
version of the web page. 

12. (Previously Presented) The method of claim 9, wherein versions of 
the web page may differ in one or more of the following: layout, images, content, 
links, hypertext elements, complexity. 
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13. (Previously Presented) The method of claim 12, wherein each version 
of the web page only varies in one feature, such that each feature of the web page 
is independently tested for effectiveness. 

14. (Previously Presented) The method of claim 13, wherein the most 
effective version of the web page includes each feature having a highest rate of 
occurrences of the desired behavior. 

15. (Previously Presented) The method of claim 9, wherein the versions 
of the web page may be generated on-the-fly, when a request for the web page is 
received. 

16. (Previously Presented) The method of claim 9, wherein the versions 
of the web page are static web pages, generated in advance, and further 
comprising: 

configuring the versions of the test page in effective parallel paths. 

17. (Previously Presented) The method of claim 9, wherein the successful 
response comprises one or more of the following: reading the web page, following a 
link, purchasing an item, filling-in a form, interacting with the web page, downloading 
data from the web page. 

18. (Withdrawn) A method of improving effectiveness of a web page 
comprising: 
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defining and prioritizing objectives of a web page; 
determining a definition of success for each objective; 
testing the web page, the testing comprising: 

designing at least two versions of the target web page, focusing 
on the objectives; and 

displaying a version of the target web page to a user, the 
version selected according to a predetermined distribution function; 
at a conclusion of the testing, identifying a success ratio for each objective. 

19. (Withdrawn) The method of claim 18, further comprising selecting the 
web page from a plurality of pages, the selecting comprising: 

computing a priority ranking for each web page on the web site, based on the 
objectives; and 

selecting a web page having a highest priority objective. 

20. (Withdrawn) The method of claim 18, wherein each version of the web 
page varies at least one aspect of the web page. 

21 . (Withdrawn) The method of claim 20, wherein aspects of the web 
page include one or more of the following: layout, graphic, link, text. 

22. (Withdrawn) The method of claim 20, wherein the success ratio of 
each aspect is measured separately. 
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23. (Withdrawn) The method of claim 22, wherein for each aspect of the 
web page, the version having the highest success ratio is chosen for the optimized 
web page. 

24. (Withdrawn) The method of claim 18, wherein each version of the 
target web page is dynamically generated in response to a request. 

25. (Withdrawn) The method of claim 18, wherein each version of the 
target web page is a static web page, generated prior to the testing. 

26. (Withdrawn) The method of claim 18, wherein the successful 
response comprises one or more of the following: reading the web page, following a 
link, purchasing an item, filling-in a form, interacting with the web page, downloading 
data from the web page, clicking on a banner advertisement. 

27. (Withdrawn) A method of improving effectiveness of a web page 
comprising: 

defining a plurality of features of the web page; 

defining a successful user response for a feature of the web page; 

designing a plurality of versions of the web page, each version varying one 
feature of the web page; 

directing users to one of the versions of the web page in accordance with a 
predetermined distribution function; and 

measuring the successful responses for the feature of the web page. 
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28. (Withdrawn) The method of claim 27, wherein the successful 
response is defined as interacting with the web page. 

29. (Withdrawn) The method of claim 27, wherein the successful 
response comprises one or more of the following: reading the web page, following a 
link, purchasing an item, filling-in a form, interacting with the web page, downloading 
data from the web page. 

30. (Currently Amended) A computer data signal embodied in a carrier 
wave comprising: 

a web page display code segment to display a version of the web page to a 
user, the version selected from a plurality of versions of the web page according to a 
predetermined distribution function; 

an evaluation code segment to count the occurrence of a desired behavior of 
the user to track the effectiveness of each version of the web page. 

31 . (New) The process of claim 5, wherein success comprises one or 
more of the following: reading the web page, following a link, purchasing an item, 
filling-in a form, interacting with the web page, and downloading data from the web 
page. 

i 
I 

32. (New) The process of claim 6, wherein relative effectiveness 
comprises one or more of the following: reading the web page, following a link, 

! 

10/029,635 8 005863.P001R 



purchasing an item, filling-in a form, interacting with the web page, and downloading 
data from the web page. 
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